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Abstract. Effective bounds on the union probability are well known to be 
beneficial in the analysis of stochastic problems in many areas, including prob¬ 
ability theory, information theory, statistical communications, computing and 
operations research. In this work we present new results on bounding the 
probability of a finite union of events, P ^ fixed positive in¬ 

teger N, using partial information on the events in terms of {P{Ai)} and 
CjP{Ai n Aj)} where ci, ..., cj^ are given weights. We derive two new 
classes of lower bounds of at most pseudo-polynomial computational complex¬ 
ity. These classes of lower bounds generalize the existing bound in [18] and 
recent bounds in [32, 33] and are numerically shown to be tighter in some cases 
than the Callot-Kounias bound [14, 17] and the Prekopa-Cao bound [26] which 
require more information on the events probabilities. 

1. Introduction. Lower and upper bounds on the union probability P 

in terms of the individual event probabilities P(Ai)’s and the pairwise event prob¬ 
abilities P{Ai n Aj)’s were actively investigated in the recent past. The optimal 
bounds can be obtained numerically by solving linear programming (LP) problems 
with 2^ variables (for instance, see [31, 26]). Since the number of variables is ex¬ 
ponential in the number of events. A, some suboptimal but numerically efficient 
bounds were proposed, such as the algorithmic Bonferroni-type lower/upper bounds 
in [19, 2]. 

Among the established analytical bounds is the Kuai-Alajaji-Takahara lower 
bound (for convenience, hereafter referred to as the KAT bound) [18] that was 
shown to be better than the Dawson-Sankoff (DS) bound [7] and the D. de Caen 
(DC) bound [8]. Noting that the KAT bound is expressed in terms of {P{Ai)} 
and only the sums of the pairwise event probabilities, i.e., ^(A C Aj)}, in 

order to fully exploit all pairwise event probabilities, it is observed in [3, 15, 16] 
that the analytical bounds can be further improved algorithmically by optimizing 

Key words and phrases. Probability of a union of events, lower and upper bounds, linear 
programming, error probability. 

This work was supported in part by NSERC of Canada. Parts of this work were presented at 
the 2015 IEEE International Symposium on Information Theory, Hong Kong, June 2015. 


1 



2 


JUN YANG AND FADY ALAJAJI AND GLEN TAKAHARA 


over subsets. Furthermore, in [26], the KAT bound is extended by using addi¬ 
tional partial information such as the sums of joint probabilities of three events, 
i.e., 1 P{Ai n Aj n Ai), i = 1, ..., N}. Recently, using the same partial infor¬ 

mation as the KAT bound, i.e., {P{Ai)} and {'^j.j^iPiAi H Aj)}, the optimal 
lower/upper bound as well as a new analytical bound which is sharper than the 
KAT bound were developed by Yang-Alajaji-Takahara in [32, 33] (for convenience, 
these two bounds are respectively referred to as the YAT-I and YAT-II bounds). 

In this paper, we extend the existing analytical lower bounds, the KAT bound and 
the YAT-II bound, and establish two new classes of lower bounds on P ^IJ^i 
using {P{Ai)} and CjP{Ai n Aj)} for a given weight or parameter vector c = 
(ci,... ,Cf^)'^. These lower bounds are shown to have at most pseudo-polynomial 
computational complexity and to be sharper in certain cases than the existing 
Gallot-Kounias (GK) bound [14, 17] and Prekopa-Gao (PG) bound [26], although 
the later bounds employ more information on the events joint probabilities. 

More specifically, we first propose a novel expression for the union probability 
using given weight vector c. Then we show using the Gauchy-Schwarz inequality 
that several existing bounds, such as the bound in [6], the DC bound and the 
GK bound, can be directly derived from this new expression. Next, we derive two 
new classes of lower bounds as functions of the weight vector c by solving linear 
programming problems. The existing KAT and YAT-II analytical bounds are shown 
to be special cases of these two new classes of lower bounds. Furthermore, it is noted 
that the proposed lower bounds can be sharper than the GK bound under some 
conditions. 

We emphasize that our bounds can be applied to any general estimation problem 
involving the probability of a finite union of events. In particular, they can be 
applied to effectively estimate and analyze the error performance of a wide variety of 
coded or uncoded communication systems under different decoding techniques (see 
[28, 19, 34, 6, 2, 22, 27, 3, 5, 20, 33, 23] and the references therein). Such bounds can 
also be pertinently useful in the analysis of asymptotic problems such as the Borel- 
Gantelli Lemma and its generalization (e.g., [9, 11, 13, 10]). Finally, we note that 
the proposed bounds provide useful tools for chance-constrained stochastic programs 
(e.g., see [25, 29]) in operations research. More specihcally, using partial information 
of uncertainty, the proposed bounds on the union probability can be applied to 
formulate tractable conservative approximations of chance-constrained stochastic 
problems, which can be solved efficiently and produce feasible solutions for the 
original problems (see, for instance, [24, 21, 4]). An example of such application is 
the work by [1] on the probabilistic set covering problem with correlations, where 
the existing KAT bound is used to tackle the case where only partial information 
on the correlation is available. 

The outline of this paper is as follows. In Section 2, we propose a new expres¬ 
sion of the union probability using weight vector c and show that many existing 
bounds can be directly derived from this expression. In Section 3, we develop two 
new classes of lower bounds as functions of the weight vector c and discuss their 
connection with the existing bounds, including the KAT bound, the YAT-II bound 
and the GK bound. Finally, in Section 4, we compare via numerical examples exist¬ 
ing lower bounds with the proposed lower bounds under different choices of weight 
vectors. 
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2. Lower Bounds via the Cauchy-Schwarz Inequality. For simplicity, and 
without loss of generality, we assume the events {^i,..., are in a finite proba¬ 
bility space (n, ^, P), where N is a fixed positive integer. Let ^ denote the collec¬ 
tion of all non-empty subsets of {1, 2, ..., N}. Given B € we let ujb denote the 
atom in ufLiAi such that for alH = 1,..., iV, ujb G Ai ifi € B and ujb ^ Ai ifi ^ B 
(note that some of these “atoms” may be the empty set). For ease of notation, for a 
singleton w £ fl, we denote P({w}) by p{uj) and P{wb) by ps. Since {ujb '■ i G B} is 
the collection of all the atoms in Ai, we have P{Ai) = J^uigA- p{'^) — '^BeSS-iesPB^ 
and 


(1) 

\i=l / Bess 

Suppose there are N functions fi{B),i = such that fii^) = 1 

any B G (i.e., for any atom ujb)- If we further assume that fi{B) = 0 ii i ^ B 
(i.e., cjJb ^ Ai), we can write 

C N \ / N \ N 

U ^0 = E E = E E (2) 

i=l / Bess \i=l / i=l BeSS-.ieB 


Note that if we define the degree of w, deg(a;), to be the number of A^’s that 
contain w, then by the definition of wb, we have deg(a;B) = \B\. Therefore, 


satisfies M^) 


MB) 


1 _ 1 
|S| deg(a;B) 
0 


a i G B 
Hi ^ B 


1 and (2) becomes 




N 

PB 


N 


EE 

i—l (jj£Ai 


p{M 

deg(u;) ■ 


( 3 ) 

( 4 ) 


Note that many of the existing bounds, such as the DC bound, the KAT bound and 
the recent bounds in [32] and [33], are based on (4). 

In the following lemma, we propose a generalized expression of (4). To the best 
of our knowledge this lemma is novel. 


Lemma 2.1. Suppose {ujb,B G are all the 2^ — 1 atoms in IJj A^. If c = 
(ci,... G satisfies 


then we have 


Cfe 7 ^ 0, for all B G Its 


keB 


N 


N 


r UA =1:1: 


CiPB 




i=i BeSS-.ieB 'M^keB 
_ Cip{uj) 

i=l uieAi '^{k-.uieAk} ''fe 


( 5 ) 


( 6 ) 


MB) 


Cj 

0 


Proof. If we define 


Hi GB 
Hi ^B 


( 7 ) 
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where the parameter vector c = (ci, C 2 ,..., cn)^ satisfies ^ 

B & 3§ (therefore Ci 7 ^ 0, * = 1,. .., TV), then ^■ /i(w) = 1 holds and we can get (6) 
from (2). □ 

Note that (6) holds for any c that satisfies (5) and is clearly a generalized ex¬ 
pression of (4). 


2.1. Relation to the Cohen-Merhav bound by [6]. Let fi{B) > 0 and mi{uiB) 
be non-negative real functions. Then by the Cauchy-Schwarz inequality, 

2 


I] MB)pb 

.B-.ieB J LB:ieB 

Thus, using (2), we have 

/ N \ N 


Pb 

MB) 


mliujB) 


> 


PBmiiwB) 


.B:i£B 


^’(Ua)=E E 

i—1 


^ V 

i—\ 2-^B'.i^B 


PB 


■m: 


'i^B)- 


\i=l / i=l B-.i^B i=l fi{B) 

If we define fi{B) by (3), then the above inequality reduces to 




[EB■.i(^BPBm^{u}B)y 


= E 


\i=l 




( 8 ) 


(9) 


( 10 ) 


where the equality holds when mi{uj) = (i.e., mi{u!B) = i^)) which was first 

shown by Cohen and Merhav [6, Theorem 2.1]. 

When mi{uj) = Ci > 0, (10) reduces to the DC bound 

/ N \ 




^P{A,)Y 




E,cfP(A,nA,) 


= E 




JY^PiAnA^) 


= Mg- (11) 


Note that as remarked in [12], the DC bound can be seen as a special case of the 
lower bound 

P ("ru U 


( 12 ) 


when Ci = 


P{Ai) 


E, PiAiHAj) 


4=1 

. This is because 




P{Ai 


j:,P{AinAj) 


P{AY 


1 2 


(e. 


p{aA 

Ej B(AinAj 




E. E, ( 


P(Ai) 

E,B(4i>nA,) 


)' P{A n A,) Y.. [ UjltU ) )' E n A,)| 


*^DC 

^DC 


= Ac- 


(13) 

Note that although q > 0 is not assumed in (12), one can always replace Ci by |ci| 
in (12) if Ci < 0 to get a sharper bound. 

However, the lower bound in (12) is looser than the following two (left-most) 
lower bounds (which we later derive in (20) and (22)): 


fP(AM 


> 


iEA^B(A)y 


> 


iEAM)y 


(14) 


N 

(^iEk^icPiAi n Ak) EiEfcDCfcP(Ai nHfc) EiEj^fPiAiP^Aj) 
where Ci > 0 for all i and the last inequality can be proved using 2ciCj < cf -f c|. 
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2.2. Relation to the Gallot-Kounias bound. By the Cauchy-Schwarz inequal¬ 
ity, or assuming mi{uj) = 1 in (8), we have 


E 


E 


PB 

MB) 


2 


> 


E PB 

.B:i£B 


p{aM- 


(15) 


Using fi{B) defined using c in (7) (note that fi{B) > 0 is equivalent to q > 0 for 
all i), we have 


CiPB 



.B-.i^B Sfces Cfc^ 


^ 1 c 


> p{aM- 


(16) 


Note that 


E 


J2keB 

Ci 


B:ieB 

Therefore, we have 


Then for all i. 


1 CkP{Ai n Ak) 

PB = -1^ E <^^PB = — 


Ci 


k—1 B:i^B ,k^B 


Ci 


CiPB 

J2k CkP{Ai n Ak) 

.B-.ieB ^keB Cfe_ 

Ci 


> p{aM 


E 


CiPB 


> 


c^P{AM 


SfeGB''fc CiJ^k^kPiAiCl Ak) 
By summing (19) over i, we get another new lower bound: 

p(\ Li ^ > V c^PjAM 

VY 7 ■^c.EfcCfcP(A,nA,)' 

Note that we can use Cauchy-Schwarz inequality again: 


N 

E' 


c^piA^r^ 


Ci Z)fc CfcP(Ai n ^fc) 

which yields 

/ \ N 


i:«.E CkP{A,r\Ak) 


> 


Y.^^P{A,) 




c}P{AM 


> 


E.c.P(A,)]^ 


^ c, Y.k ckP{A, n Ak) - Efc CiCkP{A, n Ak) ' 


(17) 

(18) 

(19) 

( 20 ) 

( 21 ) 

( 22 ) 


Since the above inequality holds for any positive c, we have 
p fu ^ max E , > max 


E.c.P(7l,)] = 


cgr^ ^ Ci J2k CkP{Ai n Ak) cgr^ J2k CiCkP{Ai n Ak) 


(23) 


One can show that by computing the partial derivative with respect to ci and 
set it to zero that 

N 


max 


E 


c?P(^.)^ 


E.c.P(7l0]^ 


cgrn ^ a Yjk CkPiAi n Ak) cgr^ J2k CzCkP{Ai n Ak) 


=■ Mk, 


(24) 


where £qk is the Gallot-Kounias bound (see [12]), and the optimal c can be obtained 
from 


Sc = cc. 


(25) 
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where a = {P{Ai), P{A 2 ),..., P{An))'^ and H is a N x N matrix whose (*,j)-th 
element equals to P{Ai fiAj). Thus, we conclude that the lower bounds in (23) are 
equal to the GK bound as shown in [12] if c S otherwise, the lower bounds in 
(23) are weaker than the GK bound. 


3. New Bounds using {P(Ai)} and CjP{Ai n Aj)}. 

3.1. New Class of Lower Bounds when c satisfies (5). 

Theorem 3.1. For any given c that satisfies (5), a new lower bound on the union 
probability is given by 


where 



N 

— “■ ^NEW-i{c), 

i=l 


(26) 


Uc) = P{A) 


Cj 


Ci 


Ci J 2 k ckP{Ai n Ak) 




E 


fees. 


(0 Cfe 


Pi^^) (EfcesW Ck) (EfceB(^) Cfc^ 


(27) 


where and are subsets o/ {1,..., iV} that satisfy the following conditions. 


^ // > 0 and min{B,,gB} < 0, then 


□ (j) 'l^keB^'k ^kGB^k „ 

B\ = arg max - ^- s.t. -^ - < 1), 

Ci Ci 


d(0 

±>2 = max 


EfeeB 


{B:iGB} Ci 

V > 0 and min^BneB} > 0 , then 

B^f^ = arg max ^ 

{B'.i^B^ Ci 

^ ^ EfcgB '"fc ^ Efc c.kP{Ai n Afc) 


B 2 = arg min 


Ci CiP{Ai) 

'Bk&B 


{B:i^B} Ci 

^ ^ 'Bk^B ^ Efc ckP{Ai n Ak) 


CiP{Ai) 


< 0 < {“lax 

'BkeB ^k 


(28) 


(29) 




then 


d(0 

B\ ^ = arg max 

{B'.i^B^ Ci 

d(0 ■ ^k^B 

BX = arg mm -^-. 

{B:iG.By Ci 


, J2kGB ^ n 
S.t. - < 0, 


Ci 


(30) 

























ON BOUNDING THE UNION PROBABILITY 


7 


4- If E. > <; max 


then 


'pwr 

Yfk&B Cfc 

5 

Ci 

Yfk^B 


, YfkeB J2k ckPjAj n Ak) 

'■■ C. - c.P{A,) 




bY> 

= are max 




= arg max 


{B-.i^B} 


(31) 


ct.p(A nAi.) 

Proof. Note that for the third and fourth cases, under the condition *’ c-p\a ) —~ ^ 

Y' ck 

0, the elements of c cannot be all positive or negative, so the set {B : i G B, — < 

0} is not empty. Therefore, the solutions of and always exist. The proof 
is given in Appendix A. □ 


Remark 1 (The new bound ^new-i(c) v.s. the GK bound £gk)- For any c G , 
we have these relations between different lower bounds: 


N 


^NEw-i(c) > 


c^piA^r 


ciY.k^kP{Ai nAk) 


> 


[ErC^P{A,)Y 


J2i J2k CiCkP{A^ n Ak) 


> 


[E^c^PjAY]^ 


(32) 


Note that if c obtained by the GK bound satisfies c G R+, then £new-i(c) > -^gk- 
This can be proven by first noting that the two constraints of (42) and the Gauchy- 
Schwarz inequality yield (19). Then by (23), we can get that £gk is a lower bound 
of £new-i(c). 


Remark 2 (The new bound ^new-i(c) v.s. the KAT bound .^kat)- One can easily 
verify that £new-i(k1) = ^kat, where 1 is the all-one vector of size N and k is any 
non-zero constant. 


Lemma 3.2. When c G , the lower bound £new-i{c) can he computed in pseudo¬ 
polynomial time, and can be arbitrarily closely approximated by an algorithm run¬ 
ning in polynomial time. 

Proof. See Appendix B. □ 


Corollary 1. (New class of upper bounds fiMEW-iic)): We can derive an upper 
bound for any given c G by 


-F ( U ] < (—^-1" CiP{Ai) 

VV / VmmfcC/c EkCkJ^ 


(minfc Cfc 


CiCkP{Ai nAk) =: hpjEW-iic). 


(33) 


The proof is given in Appendix C. According to the results from randomly generated 
c, it is conjectured the optimal upper bound in this class is achieved at c = k1 where 
K is any non-zero constant. 
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3.2. New Class of Lower Bounds when c G We only consider c G 
in this subsection. A new class of lower bounds, -^new-iIi is given in the following 
theorem. 

Theorem 3.3. Defining SS~ = ..., iV}, 7 ^ := := P{Ai) 

and 


6 := max 


7 i - (Z]fe Cfc - miufc Cfe) I 


miUfe Cfc 


where c G another class of lower bounds is given by 


(34) 


N 


N 




(35) 


where 

^i{c,x) =[P{A,) -x] 


Ci 


Ci 


Cl J2k Cfe [P{^i bl Ak) - x] 


E 


fces^ Ck J2k£B^''> Cfe [P{Ai) x] Cfe) (EfegB« Cfe) j 


(36) 


and 


= arg max 

{BeSS-:ieB} Ci 

^ ^ ^k£B Cfe ^ Efe Cfe [-^(^1 n Afe) — x\ 


Ci 


old 

i >2 = ^rg mm 


Ci [P{Ai) - x] 
J^keB Cfe 


{B€3S-:i€B} Ci 

^ ^ EfegB Cfc ^ Cfe [P{Ai n Afc) — x\ 


Ci 


a [P{Ai) - x] 


(37) 


Proof. Let x = P{i. 2 ,...,n} ^tnd consider J2i x) + x as a new lower bound where 
where (c, x) equals to the objective value of the problem 


E CiPB 

- 

SfcesCfe 

S.t. ^ PB = P{Ai)-X, 
B-.ieB,Be^- 


E PB = j- E Cfe [Pi^^ n Afe) - : 


B:ieB.B£SS- 
Pb > 0, for all B G 


such that i £ B. 


(38) 


The solution of (38) exists if and only if 

7 * - (J2k<^k)x 


min Cfe < 

k X 


<Ecfe-mi 


mm Cfe. 

k 


(39) 
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Therefore, the new lower bound can be written as 


min 

X 


X 


N 


S.t. 


7i - (Efc Cfc 


minfc Cfe) Ui 


minfc Cfc 


<x< 


"fi - {miTLk Ck)ai 

^ 

2^^ Cfc - miiife Cfe 


(40) 


We can prove that the objective function of (40) is non-decreasing with x. There¬ 
fore, defining 5 as in (34), the new lower bound can be written as (35) where £((c, S) 
can be obtained by solving (38), which is given in (36). We refer to Appendix D 
for more details of the proof. □ 


Remark 3 (£new-ii(c) v.s. ^new-i(c)). Note that .^new-i(c) = where 

£i(c) is the solution of (42). The optimal variable P{i,...,Ar} in (42) is not required to 
be the same for each £i{c),i = 1,..., A^. The lower bound •^new-ii(c), however, is 
the solution of the same problem as for £new-i(c) with the additional constraint that 
the optimal variable in (42) has the same value for each £i{c),i = 1,..., N. 

Therefore, if c € , ^new-i(c) is the solution of a relaxed problem to the problem 

for obtaining .^new-ii(c); thus £new-ii(c) > .^new-i(c). Also, since c S the 
solution of (37) can be computed in pseudo-polynomial time and has a polynomial¬ 
time approximation algorithm. 

Remark 4 (The new bound £new-ii(c) v.s. the YAT-II bound £yat-ii)- One can 
easily verify that £new-ii(k1) = f?YAT-ii, where 1 is the all-one vector of size N and 
K is any non-zero constant. 


Corollary 2. (Improved class of upper hounds hNEW-ii{c))- We can improve the 
upper bound hNEW-i{c) in (33) by 


P LJA <niir 


Efc CkP{Ai n Ak) - (minfc Ck)P{Ai) 


X)fc Cfc - minfc Ck 


+ 


minfc Cfc Ufc Cfe - minfe Cfc 

1 




(41) 


(minfc Cfc)(Efc Cfe - niinfc. Cfc) 


EE CiCkP{Ai n Afc), 


i k 


=: hNEW-n{c). 


Note that the upper bound hNEW-iiic) in (41 ) is always sharper than hNEW-i in (33). 
The proof is given in Appendix E. According to numerical examples using randomly 
generated c, it is conjectured the optimal upper bound in this class is achieved at 
c = k 1, where k is any non-zero constant. 


4. Numerical Examples. The same eight systems as in [32] are used in this 
section. For comparison, we include bounds that utilize {P{Ai)} and {22)^ P{Ai fl 
Aj)A = 1,..., N }, such as ^kat, Aat-ii and the optimal lower bound £yat-i in this 
class. Furthermore, we included the GK bound £gk which fully exploit {P(Ai)} 
and {P{Ai fl Aj)} and the PG bound [26], denoted as £pg, which extends the KAT 
bound by using {P(Ai)}, {J2j PiA^ G Aj)} and {J2j,i O Aj n A/)}. 
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In the numerical examples, c is obtained by the GK bound; the elements of 
are given by {c^ = max(ci, e),i = 1,..., N} where e > 0 is small enough so that if 
c € then = c. 

We present ^new-i(c), I’new-i(c~*"), -^new-ii(£"*") and max^ •^new-i(c + k 1) in Ta¬ 
ble 1. In three examples (Systems II, III and VIII), c G therefore ^new-i(c) = 
^new-i(c''")- In two examples (Systems VI and VII), ^new-i(c) gives a negative 
value so we ignore it and replace it by 0. The lower bound max„ £new-i(c -I- k 1) is 
done by searching k from —1 to 1 with a fixed step length 0.005 (so that 401 points 
are used in total). We also randomly generated 100, 000 samples of c G to com¬ 
pute £new-i(c) and ^new-ii(c) and the largest bounds were selected and denoted 
as ^NEW-l(C]^and) ^nd ^NEW-Il(cRand)- 

From the results, one can see £new-i(c~'') is always sharper than £new-i(c) and 
is sharper than in most of the examples except for System VI. The line search 
max„ ^new-i(c+ k 1) is sharper than £new-i(c''^) in most of the examples except for 
System V. Since G the class of lower bounds •^new-ii(c''’) is always sharper 
than ^NEW-i(£’*’), as expected. Furthermore, the PG bound which uses sums of 
joint probabilities of three events, may be even poorer (e.g., see Systems I and VI) 
than the numerical bound £yat-i which utilizes less information but is optimal in 
the class of lower bounds using {P{Ai)} and P{Ai fl Aj)}. It is also weaker 
than the proposed lower bounds in several cases (see Systems I-IV). 

In Table 2, we compared .£new-i(c) and £new-ii(c) with randomly generated 
c G One can see that in System VI, the maximum ^new-ii(c) is 0.3203 which 
is sharper than the maximum I'new-i(c) which is 0.3022. Also, the percentage that 
•^new-ii(c) is strictly larger than .^new-i(c) and the averages of are shown 

in Table 2. 

5. Conclusion. In this paper, we present new bounds on the probability of finite 
union of events using {P(Ai)} and weighted sums of pairwise event probabilities 
CjP{Ai n Aj)}. Two new classes of bounds are proposed which generalize the 
existing KAT bound and the recently derived YAT bounds. It is also shown that 
the proposed bounds can be tighter in some cases than the existing GK bound and 
PG bound which require more information on the events probabilities. These new 
general union probability bounds can be applied to effectively estimate and analyze 
the error performance of a variety of coded or uncoded communication systems. 
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Table 1. Comparison of lower bounds (* indicates c G and a 
bold number indicates the best results among all tested bounds.) 


System 

I 

II* 

III* 

IV 

V 

VI 

VII 

VIII* 

N 

6 

6 

6 

7 

3 

4 

4 

4 


0.7890 

0.6740 

0.7890 

0.9687 

0.3900 

0.3252 

0.5346 

0.5854 

^KAT 

0.7247 

0.6227 

0.7222 

0.8909 

0.3833 

0.2769 

0.4434 

0.5412 

ioK 

0.7601 

0.6510 

0.7508 

0.9231 

0.3813 

0.2972 

0.4750 

0.5390 

ipG 

0.7443 

0.6434 

0.7556 

0.9148 

0.3900 

0.3240 

0.5281 

0.5726 

£yat-u 

0.7247 

0.6227 

0.7222 

0.8909 

0.3900 

0.3205 

0.4562 

0.5464 

^YAT-I 

0.7487 

0.6398 

0.7427 

0.9044 

0.3900 

0.3252 

0.5090 

0.5531 

.^NBW-l(c) 

0.6359 

0.6517* 

0.7512* 

0.7908 

0.3865 

0 

0 

0.5412* 

^NEW-l(c"'") 

0.7638 

0.6517* 

0.7512* 

0.9231 

0.3900 

0.2951 

0.4905 

0.5412* 

^NBW-l(c + k1) 

0.7577 

0.6539 

0.7557 

0.9235 

0.3899 

0.2993 

0.4949 

0.5412 

^NBW-l(c;^^nd) 

0.7783 

0.6633 

0.7810 

0.9501 

0.3900 

0.3022 

0.4992 

0.5666 

^NBW-Il(c''") 

0.7638 

0.6517 

0.7512 

0.9231 

0.3900 

0.2951 

0.4905 

0.5412 

^NBW-Il(c;^^nd) 

0.7783 

0.6633 

0.7810 

0.9501 

0.3900 

0.3203 

0.4992 

0.5666 
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Table 2. Comparison of ^new-i(c) and •^new-ii(c) with randomly 
generated c S (a bold number indicates max£NEW-ii(c) > 
max£NEW-i(c).) 


System 

V 

VI 

VII 

VIII* 

N 

3 

4 

4 

4 


0.3900 

0.3252 

0.5346 

0.5854 

max£NEW-i(c) 

0.3900 

0.3022 

0.4992 

0.5666 

max £new-ii (c) 

0.3900 

0.3203 

0.4992 

0.5666 

^NEW-l(c) 

1.0011 

1.065 

1.0006 

1.0000 

Percentage ^new-ii(c) > ^new-i(c) 

7.82 % 

69.6% 

3.87% 

0.54 % 
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Appendix A. Proof of Theorem 3.1. We note that ii{c) is the solution of 

E CiPB 

^ - 


3.t. ^ PB= P{Ai), 

B:ieB 

f^MB^'\pg = Lj2ckPiA,r]Ak), 


\ ‘ ‘ fc 

Pb > 0, for all B G ^ such that i G B. 


(42) 


From (42) we have that 


E 

B-.i^B 


CiPB 




Summing (43) over i and using ( 6 ) we directly obtain 


N 


N 




(43) 


(44) 


Note that we can solve (42) using the same technique used in [32, 33]. Consider 
two subsets Bi and B 2 such that > 0 and > 0 , then denoting 


X)feCfeP(AinAfc) SfceSi Cfe SfeeSa 

-, 0i - ,02 -, 


CiP{Ai) 

then problem (42) reduces to 


Ci 


Ci 


(45) 


0 ! \ ■ PBl , PB 2 

li{c) = mm 1 — + 1 — 

{pBijPBal 0i O 2 

S.t. psi +PS 2 = P{Ai), 

hPBi + b2PB2 = bP{Ai), 
PBi > 0, PB 2 > 0. 

According to [32, Appendix B], one can get that 


(46) 


ii(c) = min 

{bi,&2:fcl<f)<b2} 


^ 62 6162 


(47) 


and the partial derivative of P{Ai) ^ ~ falfe) ^i^h respect to 61 and 62 are 

(see [32, Appendix B, Eq. (B.3)]): 


dhi 


db2 



(b-b2\ 

bl 

1 b2 ) 

P{Ai) 

(b-bA 

bl 

V 61 ; 


(48) 


Note that the partial derivatives are not continuous at 5i = 0 and 62 = 0. Therefore, 
the solution depends on the following different scenarios. 

1. If 6 > 0 and 

Sfces Cfc 


{B-.iGB} a 


<0, 
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the solutions of (47) are given by 


Oi = max - s.t. - < 0, 

{B-idB} a a 

7 Yhk^B 

02 = max -s- 

{B:ieB} Ci 


2. If 6 > 0 and 


J2keB ^ n 
mm -s- > 0, 


{B-.iGB} a 

the solutions of (47) are given by 


b2 = 


3. If 6 < 0 and 


max 

'l2k£B 

Ck 

s.t. 

EfeGB Cfe ^ 

{B:iGB} 

Ci 



Ci 

min 

^keB 

Ck 

s.t. 

J2kGB Cfc ^ j 

{B-.i&B} 

Ci 



Ci 

max 

^keB 

Ck 

s.t. 

Ylik^B ^ q1 

{B:ieB} 

Ci 



Q j 


the solutions of (47) are given by 

, Y^k&B 

0 i = max -, 

{B-.i^B} a 

, • Thk^B^^ 

02 = rmn -s- 

{B:ieB} Ci 


s.t. < 0, 


4. If 6 < 0 and 


b > < max 


J2keB 

JB:ieB} a 

the solutions of (47) are given by 

, 'l2k£B^k 

bi = max -, 

Ci 

u 'Bk^B^k 

02 = max - 

{B:ieB} d 


s.t. < 0 


s.t. < b. 

Ci 


(49) 


(50) 


(51) 


(52) 


Appendix B. Proof of Lemma 3.2. The problems in (28) to (31) are exactly 
the 0/1 knapsack problem with mass equals to value (see [30], the corresponding de¬ 
cision problem is also called subset sum problem). Unfortunately, the 0/1 knapsack 
problem is NP-hard in general. 

However, if c G i.e, the case (29), there exists a dynamic programming solu¬ 
tion which runs in pseudo-polynomial time, i.e., polynomial in TV, but exponential 
in the number of bits required to represent [30]). Furthermore, 

there is a fully polynomial-time approximation scheme (FPTAS), which finds a so¬ 
lution that is correct within a factor of (1 — e) of the optimal solution (see [30]). 
The running time is bounded by a polynomial and 1/e where e is a bound on the 
correctness of the solution. 
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Therefore, if c G one can get a lower bound for ii{c) in polynomial time 
which can be arbitrarily close to ii{c) by setting e small enough, i.e.. 


^i(c) >£f(c,e), lim £f(c,e) =£*(c). 

e—>- 0 + 


(53) 


The details are as follows. First, assume Bi and B 2 are obtained by the FPTAS 
which satisfy 


(0 


Then we have 




^ Cfc < min ■ 


fees 


(i) 


Ck > max ■ 


kSB, 


(i) 


\ / \ 

M 

Ck< Y Cfc < (1 + e) Y 

Cfc ■ 

fees)’’ 

keB^''’ k^B^'^ 

keB^*‘ 

1 

(54) 


CfcP(Ai n Ak) \ 



1-e ’ 

P{A.) J 


' Sfcgst-) 

CkP{Ai n Ak) 

1 ■ 

(55) 

l + e 

P{A.) 

> . 02 . 



Then one can get the arbitrarily close lower bound for £i{c) as 


(56) 


Therefore, we can get a lower bound for P that is arbitrarily close to 

•^NEW-i(c) in polynomial time: 


N 




(57) 


Appendix C. Proof of Corollary 1. We get the upper bound by maximizing, 
instead of minimizing, the objective function of (42). More specifically, for any 
given c G M+, a upper bound can be obtained by 

N 

Hc) = '^h^{c), (58) 

i=l 


where hi{c) is defined by 

hAc) := max — 


CiPB 




3.t. ^ pB = P{Ai), 


B-.iGB 




- ^ C/i;P(Aj n Afc) , 

O: < ^ 


(59) 


B-.ieB 

Pb > 0, for all B € 


such that i € B. 









ON BOUNDING THE UNION PROBABILITY 


17 


The resulting upper bound is given by 


P 





CkP{A, n Ak) 


minfe Cfe Cfc (minfe Ck)J 2k<^k 


'.P{A{) 


\ mmfc Cfc 



1 

(minfc Cfe) Cfc 


EE CiCkP{Ai n Ak). 

i k 

(60) 


Appendix D. Proof of Theorem 3.3. Let x = P{i^...^n} and define = ^\ 
N}, then consider J). i[{c, x) + x as a new lower bound where £'(c, x) is 
defined by the solution of (38), which exists if and only if 

^ 7i ~ (Sfe Cfc)a^ . /„-.N 

mincfc < -r- < > Cfe - mmcfc, (61) 

k ai- X ^ k 


which gives 


’7» - (Efc Cfc - minfc Cfc) a) 

-1- 

7 i - (minfc Cfc)Q;i' 

< X < min 
i 

minfc Cfe 

_J2k<^k- minfc Cfe_ 


(62) 


Therefore, the new lower bound can be written as (40). 

Next, we can prove that the objective function of (40) is non-decreasing with x. 
First, we prove 


^'z{c,x) = [P{A))-x\ 


Cl J2k Cfe [PiAi n Ak) - x] 


E 


fcgsW Cfe EfeesCO Cfe _ 2.] Cfe) (EfcgsW Cfc) J ’ 


(63) 


is continuous when 3B' G M such that 

Efc Ck [P{Ai n Afc) — x] _ J2k&B’ Cfe 
Ci [PiAi) - x] Ci 


(64) 


This can be proved by 


lim £'iic,x + h)= lim £'(c, x — h) = ■=— -. 

^—^0+ /i—>-0+ Z-^kGB' 


(65) 


Then one can prove that when 


Cfc ^ j2k Ck [PjAi n Afc) - x] ^ Efes^w cfc 
a Ci [PiAi) - x] Ci ' 


(66) 
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the partial derivative of £'(c, x) + — x w.r.t. x is non-negative: 

2^k 


dx 

Ci Ci 


Ci 


Efc Cfe EfcesW 




(SfcgsW 

(Efc cfc - Efcgpw cfc) (Efc cfc - EfcgB(o cfc) 
(Efe Cfe) (EfcesW Cfc) (EfegB(-) Cfe 
Ci Cfc) (Sfc^sC*) Cfc) 


(SfcCfe) (Sfcgs'*' Cfc) (Z^fcgsW Cfc^ 
Therefore, the objective function of (40), 


> 0 . 


^ £'(c, x) -h X = ^ £'(c, x) 

, \ 2^/c 


is non-decreasing with x. 

Finally, defining 5 as in (34), the new lower bound can be written as 


N 


N 


p U^d >5 + ^^'(c,d). 


(67) 


( 68 ) 


(69) 


where i'j^{c,S) can be obtained using the solution for ii{c) in Theorem 3.1 with 
^ replaced by b = 


Efc 

PiAinA^)-S] 

Ci 

[p(i:P3] 


Appendix E. Proof of Corollary 2. Letting x = Defining = 

^\{1,... ,N}, then 


b! (c) = max 

X 

where h[{c^x) is defined by 


N 




2=1 


(70) 


h'^{c,x) := max , 

B-.ieB,BeSg- ^i^^B 


E 


CiPB 


S.t. y] PB = P{Ai) - X, 

B-.i&B,BeSS- 

Y. fE§^)p3 = l^Cfc[P(A,nAfc)-: 

BAGB,B£Sg- V D / Cj ^ 

Pb > 0, for all B G such that i & B. 


(71) 
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The solution of h[{c,x) is independent with x: 
h[{c, x) = {P{Ai) -x)( -h 

Vminfc Cfc 


minfc Cfc 


-T-- -^-7 ^ ’ 

(minfc Cfc)(2^Cfc - minfc Cfe) ^ 


= PiA) 


Ci 


minfc Cfc J2k Cfe - minfc Cfc ^ 

J2'^kPiA,nAk), 


(minfc Cfc) (2] fc Cfe - minfe Cfe) 
and the solution exists if and only if for all i 

22fc (^kPjAj n Ak) — (22fc ^k)x 


min Cfe < 
k 


- Cfc 


mm Cfc. 


Thus, we get 


max 


P{A,) -X ^ 

J 2 k CkP{A^ n Ak) - {J 2 k Cfc - minfc Cfc) P(^i)'' 


< X < min 


minfc Cfc 

2]fe CkPjA^ n Afc) - (minfc Ck)P{Ai) 
J2kCk- minfc Cfc 


Therefore, we get the upper bound 

' J2k CkP{Ai n Ak) - (minfc Ck)P{Ai) 


P <niir 


Y,k^k- minfc Cfe 


+ 


minfc Cfc 2]fc Cfe - minfc Cfc 
1 




(miiifc Cfc) (22 fc Cfe - minfc Cfe) 


EE CiCkP{Ai n Ak). 
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